DOCUMENT RESUME 



ED 056 056 



TM 000 668 



AUTHOR 

TITLE 

INSTITUTION 
REPORT NO 
PUB DATE 
NOTE 



Katz, Martin R.; And others 

The Measurement of Academic Interests: Part I. 

Characteristics of the Academic Interest Measures- 

Educational Testing Service, Princeton, N-J- 

R B- 70- 57 

Oct 70 

87p. 



EDRS PRICE 
DESCRIPTORS 



identifiers 



M F— $0-65 HC-S3.29 

Ability Grouping; Correlation; Factor Analysis; Grade 
11; High School Curriculum; ♦ High School Students; 
♦Interest scales; Longitudinal Studies; ♦Occupational 
Guidance; predictive Validity; Secondary Schools; Sex 
Differences; *Student Ability; ♦Student Interests; 
Test Interpretation; Test Reliability 
♦Academic Interest Measures 



ABSTRACT 

Data presented in this study of the Academic Interest 
Measures (AIM) include score distributions for a national sample of 
high school juniors grouped by sex, ability, and curriculum (effects 
of socioeconomic status were found to be negligible) ; relationships 
between AIM and many other variables, such as ability test scores, 
students* ratings of their own interests, definiteness of 
occupational plans, years of post-secondary education planned, scores 
on information scales, and participation in nonclassroom activities; 
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properties of AIM and evidence for its construct validity suggest 
that it may be useful as a criterion measure- A self-scoring form of 
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THE MEASUREMENT OF ACADEMIC INTERESTS 



Part I. Characteristics of the Academic Interest Measures 

Abstract 

Data presented in this study of the Academic Interest Measures (AIM) 
include score distributions for a national sample of high school juniors 
(N = 15 , 500) , grouped by sex, ability, and curriculum (effects of socio- 
economic status were found tc be negligible); relationships between AIM 
and many other variables, such as ability test scores, students' ratings 
of their own interests, definiteness of occupational plans, years of post- 
secondary education planned, scores on information scales, and participation 
in nonclassroom activities; scale intercorrelations and factor analyses; 
internal consistency of scores and stability over periods of time. 

The psychometric properties of AIM and evidence for its construct 
validity suggest that it may be useful as a criterion measure. 

Data on predictive validities will appear in Part II. 

Appendix D, consisting of the norms tables, is separately bound. 
Appendix E is a self— scoring form of AIM, devised by Paul B. P' T aderi ch . 
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the measurement of academic interests 

Part I. Characteristics of the Academic Interest Measures 
INTRODUCTION TO THE ACADEMIC INTEREST MEASURES 

In the course of the eight-year Study (Smith and Tyler, 19^2), an Interest 
Index was developed to serve as a measure of the effects of secondary school 
curricula on students' interests. The modification of this Index, constructed 
primarily as a criterion measure, and the successive revisions whereby it became 
the Academic Interest Measures (AIM), intended mainly for use in guidance, are 
briefly summarized in this introduction to an extensive study of the measurement 
of academic interests . 

It has been widely believed that interests have or should have some effect 
on the career decisions made by students during late adolescence. Interests are 
generally conceptualized as an important component of motivation. They are 
hypothesised to have a significant effect on a student's decisions — for example, 
choice of a field — and on the outcomes of hxs decisions — for example, quality or 
level of achievement, expressed satisfaction, and persistence in a field. The 
student's knowledge of his own interests and of their relationship to such criteria, 
then, is presumed to be useful in the process of informed and rational decision- 
making . 

The number and complexity of options available to students in secondary schools 
and colleges appear to make adequate first-hand experience in each option difficult 
to come by. Standardized interest measures, therefore, have been developed to serve 
as a relatively brief and efficient substitute for such "real— life ' exploration 
of options. They are expected to add relevant information to what the student 
already knows about his interests. This information may take various forms. 

It may help the student to "discover" interests previously unrecognized— perhaps 
by extending his knowledge of options or of activities associated with an option. 

It may help him to perceive a new and more useful structure for his interests, 



perhaps by classifying and organizing his responses to items along dimensions 
that are particularly relevant for the choices that confront him. It may pro- 
vide him with direct interpretations , perhaps transforming his scores on the 
instrument into some index of resemblance (in conjunction with other data) to a 
relevant reference group , or of probability of attaining a given level of suc- 
cess, satisfaction, or persistence. 

Thus, interest measures may be characterized by their purpose, content, 
response form, scoring procedures, classification and. structure of scales, and 
interpretive data. AIM will be described along these lines in the general con- 
text of interest measurement. 

Content 

The items in AIM are mainly straightforward de script ions of activities that 
pi 1 + -fco represent various school subject fields. The original items for the 
Interest Index had been gathered through an examination of textbooks, extensive 
observations and analyses of classroom activities, and diaries of high school 
students. From some 600 items, 300 were then chosen and edited so that each 
item represented a unit of behavior primarily related to a single area. The 300 
ite ms were tried out in a number of schools; items that were retained had high 
correlations with total scores in their respective fields and were neither too 
popular nor unpopular to be discriminating. Some revisions were made in an 
attempt to make sure that each area was adequately sampled and that items were 
clear to students . 

In the' Comparative Prediction Study (French, 1963), half-length scales from 
the Interest Index (100 items in all) were administered to about 4800 freshmen 
in eight colleges. French (1964a) describes how a validity rank was computed for 
each item on three criteria available four years later for many of these students 



achievement in freshman courses, satisfaction with major field in the senior 
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year, and mean score (popularity) among students enrolled in each major field. 

It should be noted, however, that items ranking high on one of those three cri- 
teria, did not necessarily rank high on the other two. Most of the items seemed to 
be much more clearly associated with major field membership than with grades or 
satisfaction. This phenomenon suggests that prediction of different criteria 
probably requires different content. All-purpose predictive effectiveness is 
rare . Indeed, the correlations between appropriate scales and the criteria of 
grades and satisfaction were quite low. In general, interest inventories seem 
to be much more successful in predicting ’’the direction men will go" (Strong, 

1958 ) than in predicting how well a person will do. 

French (1964b) revised the items not found differentially valid for an 
appropriate field by at least one of the three criteria, edited other Index items 
to bring them up to date, and used the characteristics of valid items as a guide 
for writing 93 additional items . The total pool of 200 items from the Interest 
Index and 93 new items were then administered to 360 llth-grade students . On 
the bar. is of item-scale correlations (very few were below . 60 ) and representa- 
tion of the full scope of each field, 1 6 items were selected for each of 12 scales - 

Further refinement was made by Halpern ( 1967 ), who administered the revised 
Index to some 2000 llth-grade students in five school systems and then replaced 
4 of the 192 items that did not correlate at least as high with their assigned 
scales as with other scales. At this point, the name of the inventory was changed 
to Academic Interest Measures. The content of AIM items may be said, in short, to 
have been determined largely by consideration of adequate representation of a sub- 
ject field, differential predictive validity for college courses, and homogeneity 
of each scale. 

The items describe activities associated with each subject field that seem 
to be molar rather than atomistic — that is, they incorporate a cluster or series 
of actions rather than a single act. Typical items are "To put eggs into an 
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incubator and open one every day to see how the chick develops/' "To read 
about new advances in mathematics/' "To write articles for the school newspaper." 
These illustrate both the level and variation in specificity of AIM items : the 

first specifies more detail than the second. The ATM items are perhaps most 
closely comparable in degree and range of specificity (though not in substance) 
to the descriptions of work activities that characterize most of the items in 
the Occupational Interest Inventory (California Test Bureau, 1956) and many of 
the items in the Kuder Preference Record -Vocational (Science Research Associates, 
1962), especially those that start with transitive verbs, and in Part IV of the 
Strong Vocational Interest Blank (Stanford University Press, 1966). The AIM 
items seem considerably more specific than the listing of occupational titles 
and school subjects in Parts I and II of the SVTB, or in those KPR-V items such 
as "Be a chemist," "Be a salesman," "Be a bookkeeper." 

On the other hand, they may be considered less specific than items in 
pictorial interest inventories, such as the Geist Picture Interest Inventory 
(Western Psychological Services, 1964). Pictures often have a "stop-action" 
effect that may convey a single act — perhaps sometimes only a. fragment of an 
act --at a given moment. 

In inventories that are not empirically keyed, specificity is an important 
issue. If only a fragment of an activity is presented, the student's response 
may apply only to the surface of the fragment shown rather than to the molar 
activity that it presumably represents. But if, at the other extreme, an item 
is as generalized as an occupational title or the name of a subject field, one 
must assume that the student already knows his preference or liking for this 
occupation or field in order to respond in a stable or meaningf ul way. When 
indeed he does know his preference for such items, what new information does 
the inventory give him? And when he does not, he may feel like saying — with some 
Justified exasperation — "But that's why I'm taking the inventory — to find out 



■whether I'd be interested in this occupation or field." In such a case, he is 
being asked to invest the very coin he hopes to earn. 

Although the AIM items avoid the two extremes of detail and generality, an 
important question is whether they provide adequate representation of each sub- 
ject field for students who have had insufficient opportunity to explore that 
field. (Perhaps simulated work samples could offer the student a more effective 
sense of the real thing. But could such work samples be "miniaturized" enough 
to .ompare with a l6-item inventory, without too severe a loss in verisimilitude 
and scope? ) At any rate, we raise these questions about item content here to 
indicate the rationale for many of the analyses reported in the following pages, 
in which we try to bracket the content of AIM through a series of comparisons 
with many other variables --abilities , information, nonclassroom activities, occu- 
pational plans, and so on. Particularly relevant to the issue of specificity vs. 
generality are comparisons between AIM scales and ratings made by students in 
response to a single question about their own interest in each field or subject. 

Response Mode and Scoring 

The student's response to each item--Like, Indifferent, or Dislike--is 
independent of responses to other items. This procedure contrasts with the forced 
choice format that is used by several interest inventories (most notably the KPR-V) 
to avoid the effects of positive or negative response set. As has been explained 
extensively (Bauernfeind, 1963 ; Katz, 1962, 1965), the cure for response set in 
interest inventories has been worse than the disease: in the KPR-V, for example, 

it has resulted in an alternation of ipsative and normative procedures that virtu- 
ally nullify each c her, making either type of interpretation dubious. As it 
happens, response set does not appear to be an obtrusive element in AIM scores, 
since the intercorrelations among AIM scales are low, and the number of Like 
responses does not emerge as a separate dimension in a factor analysis of the 
inter correlation matrix of AIM scores, total Likes, and ability test scores. 
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Responses are scored 2 for Like, 1 for Indifferent;, and 0 for Dislike. This 
procedure is parallel with the original Interest Index scoring of 1, 0, and -1, 
tnit avoids negative scores. Since there are 1 6 items for each scale, a score of 
16 may be taken to represent an "indifference" level — a useful anchor point for 
comparing scores across scales. Paul Diederich, one of the authors of the original 
Interest Index, has devised an ingenious format enabling students to score their 
own answer sheets very quickly and simply (see Appendix E). 

Scales 

Because the procedures used in constructing and purifying AIM scales resulted 
in a relatively homogeneous set of items for each scale , the identification of 
items with a scale seems quite transparent. There is little doubt that students 
could--if they wished--"fake good" more readily on AIM scales than on the empiri- 
cally keyed scales of the SVIB, the Minnesota Vocational Interest Inventory (The 
Psychological Corporation, 1965 )^ and the Occupational Interest Survey (Science v 
Research Associates, 1966). Clearly, AIM should not be used for selection, and 
no attempt has been made to construct a "lie" scale. 

It should be noted, incidentally, that both the SVTB and the MVXI provide 
homogeneous scales, in addition to the actuarially keyed occupational scales. 

The latter are cumbersome and difficult to interpret "psychologically" (Cronbach, 
I97O, p. 465 ). Occasionally, they may foster such anomalies a.s "the finding 
that on MVII, food-service managers average higher on the Baker key (that is, 
differ more from tradesmen-in-general) than bakers do" ( ibid . , p. ^ 67 ). Indeed 
Campbell (1969) regards the Basic Interest Scales, as the homogeneous scales on 
the SVIB are called, as providing the "most important" interpretive data. Those 
scales, however, generally include no more than 12 items- Items for the SVIB 
were, as is well known, selected from a melange of items strictly on the basis 
of empirical validity, defined as differentiation of men in a given occupation 

from men-in-general. The collection of homogeneous clusters was a recent 
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afterthought . Although differential validity was also an element in selecting 
AIM items, there were other constraints: (l) items for each scale were selected 

from a population of items assembled to represent a given field; (2) validity 
was construed in respect to a subject or subject field logically appropriate to 
the scale in which the item was incorporated; (3) only items highly correlated 
with their own scale were retained. Any AIM items that turned out to be better 
predictive of marks, membership, or satisfaction in a field not logically associ- 
ated with the scale would turn out to be an embarrassment. Thus, it will appear, 
as would be expected from the procedures used in constructing AIM, that the 
internal consistencies of AIM scales are quite high. 

The current names of these scales are Biology, English, Art, Mathematics, 
Social Sciences, Secretarial, Physical Sciences, Foreign Languages, Music, 
Industrial Arts, Home Economics, and Business. 



Interpretation of Scores 

Most inventories convert raw scores into normative form for interpretation. 
Percentile ranks or standard scores are often based on some general reference 
group (cfL KPR-V) and purport to answer such questions as, "How does a student 
stand (in this interest) in relation to other high school males?" This ques- 
tion cannot be clearly answered when the items require forced-choice responses. 

But even in the best of circumstances, the utility of the answer for guidance is 
not clear. At the same time, normative conversions of raw scores often interfere 
with the more clearly useful ipsative type of comparison, in which an individual's 
interest in one field is compared with his interest in another field. The inter- 
pretation then must go, "His standing relative to other high school males is 
higher in this interest than in that." "Relative to other high school males" 
introduces noise into the ipsative comparison. His percentile rank may be much 
higher in Music than in Industrial Arts even though he as an individual prefers 
Industrial Arts. The reversal in percentile ranks is primarily a function of 
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C comparisons between absolute scores in different fields also present 
problems, of course. One field may be better represented than the other by 
AIM scales. But this problem is not avoided by a normative conversion of 
scores — it is only compounded. 

The main use of the norms tables for AIM will probably be for research, 
particularly if AIM serves--like the old Interest Index--as a criterion measure. 
Since the distributions for many of the scales are not normal, percentile ranks 
will be helpful in interpreting, let us -w, the nature of gains made by high 
ability females on the Physical Scien scs _e after exposure to m experimental 
urriculum treatment in grade 11. In o:her words, comprehensive norms for 11th- 
graders (published in conjunction with thi_> report under separate cover) may 
provide a context for understanding the effects of experience. It is difficult 
to see any use for such norms in prediction, however, except as an inadequate 
and distracting substitute for validity data. 

Prediction is the main subject of a report scheduled to appear immediately 
after this one. It will taka into account such criteria as marks and interests 
in grades 12 and 15. AIM profiles for various major field and occupational 
groups will also be included. Unlike the SVIB and OIS, however, the data to be 
reported for AIM do not emphasize group membership. Resemblance to a group may 
help predict what choice a student is likely to make. Such predictions seem to 
have very dim usefulness in guidance. The other two criteria represent outcomes 
of a choice rather than the choice itself. Admittedly much more elusive, they 
appear to represent better standards by which to judge the relevance of ATM for 
guidance. The contribution of AIM will be considered in conjunction with other 
predictors. Particular attention will be given to differential prediction. 
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BACKGROUND AND PURPOSE 

In the fall of 1966 the first tests were administered for a national 
norming and longitudinal study of the Preliminary Scholastic Aptitude Test 
(PSAT) and Academic Interest Measui. -s (AIM) , under the sponsorship of the 
College Entrance Examination Board. The major objective . _ this research 
were to revise the PSAT norms for grades 11 and 12; devel.r PS T no: is for 
grade 10; develop AIM norms for grade 11; and study the va ' cities, ossible 
uses and interpretations of AIM. 

Three sequential phases of research were planned. Phase was irected 

toward the development of norms for both PSAT and AIM and tow - gathering 
evidence of AIM’s construct validity; phase II was concerned _~h determining 
the internal consistencies and one- and two-year stabilities of scores on the 
AIM scales; phase III centered on investigating the predictive validities of 
AIM scales. 

In the course of fulfilling these study objectives, several issues of 
theoretical and practical concern for education were investigated. The re- 
search design provided an excellent opportunity to investigate the academic 
interests of high school students grouped according to sex, ability, socio- 
economic status, and curriculum membership. Intercorrelations among scores 
on the 12 AIM scales and PSAT provided a basis for studying the structure of 
academic interests; further illumination was supplied by relationships with 
variables derived from a Student Questionnaire (Appendix A) . 

The intent of the present report is to summarize some of the findings 
for phases I and II of the PSAT- AIM study"'" and relate these findings to a number 
of issues concerning the nature and measurement of academic interests. 

I 

It should be noted that this report does not include the t'Sk- norms. These norms 
for nigh school seniors, juniors, and sophomores were published ir College Board 
Score Reports (1969-70) . 
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METHOD 



An attempt was made to choose a sample of secondary schools representa- 
tive of those in the nation. In the initial stage, the PSAT and a. Student 
Questionnaire were administered to the sophomores , juniors and seniors in these 
schools. AIM was also administered to the juniors, who constituted tl popula- 
tion for a longitudinal study that extended through one year after thei high 
school graduation. 

Selection and Characteristics of the Sample 

From the more than 22,500 schools in the College Entrance Examination Board 
listing of secondary schools in the United States, 299 were selected at random. 

A school questionnaire (Appendix B) was sent to each of these schools, to obtain 
information on such characteristics as size, curricula, proportion of students 
who go on to college, instructional budgets, and willingness to participate 
in the study. Up to four follow-up inquiries were made to have each question- 
naire completed. Toward the end of the school selection process, it appeared 
that the Southwest would be underrepresented in the sample. To correct for 
geographical imbalance, two additional schools in the Southwest were asked to 
participate, bringing to 301 the total number of schools approached. Every 
school returned at least a partially completed school questionnaire. Schools 
agreeing to cooperate in this study also agreed to test all of their sophomores , 
juniors, and seniors. 

It is impossible to determine whether this sample frame represents 
"all United States secondary schools" — a population which is both nebulous 
in definition and transient in membership. All the available frames list 
high schools covering two, three, four, and six years of schooling; adult 
education schools; evening schools; correspondence schools with or without 
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classrooms; and specialized schools for various ethnic , language, or 
nationality groups. In this study, several "atypical" schools are known. 

These include a school transplanted from Cuba, one located on an Indian reser- 
vation, one restricted to mute children, and an experimental high school 
attached to a university. Clearly, however, the sample is not representative 
of all "atypical" schools. 

Even if rigid criteria for inclusion and exclusion from the population 
could be agreed upon, the population itself is continually changing as schools 
merge, new schools appear, and others disappear. Some indication of how 
rapidly the population changes is provided by the sample drawn. Although 
the frame has been "updated" amrually, the following status changes were 
found among the 301 schools: 7 had merged with another school; 3 had closed 

permanently; 7 were not secondary schools (Table l) . In other words, 6$ of 
the listings in the frame were in error. 



Insert Table 1 about here 



In this situation, a reasonable approach is to exercise all due care in 
the survey procedures and then to compare the results with those of other 
investigations in which one has confidence. To the extent that different 
investigations have adequately sampled the same population, their sample 

characteristics should be the same. 

Responses to the questionnaire sent to every sample school permit 

statistics for the total sample and for participating and nonparticipating 
schools to be compared with data published by the United States Office of 
Education (USOE). In these comparisons, chi-square was used to test the 




Table 1 



be hod Status 





N 


f 


Participating schools 
Status unchanged 


180 




Merged with noris ample d school 


5 




Additions to sample 3. 


2 




Subtotal 


187 


62 



Nonparticipating schools 
Status unchanged 


102 




Merged with nonsampled school 


2 




Not a secondary school 


7 




Closed 


3 




Subtotal 


m 


38 


Total 


301 


100 



8L 

Early returns suggested that large schools and the Southwest 
would be underrepresented. These two schools were added to correct 
for the anticipated bias. 





goodness of fit between population parameters reported by USOE, on the one 
hand, and total school sample, participating schools, and nonparticipating 
schools, on the other. 

Geographical location . The geographical distribution of neither the sample 
schools nor the participant schools differed significantly from USoE data (see 
Table 2 ). The participating schools, however, consisted of a smaller proportion 
in the Great Lakes and Plains region ( 2 6 %) and a higher proportion in the South- 
east (32%) than USOE reported (31% and 27%, respectively) . 



Insert Table 2 about here 



Proportion of public schools . USOE reported that, in 1961 - 62 , 86 % of all 
secondary schools were public. Table 3 shows statistically significant 
differences for both the sample and the participants , which have smaller 
percentages of public schools ( 82 % and 77 %; respectively). 

Insert Table 3 about here 

College-going rates . The percentages of students going on to college are 
shown in Table 4. The college-going rate for the sample was 50%, and, for the 
participants, 51%. The USOE reported a rate of 48% for 1964. USOE also 
provided a i 960 rate of 55% for all nonpublic schools . The rate for nonpublic 
participants, 73%; was considerably higher. This difference for nonpublic 
schools was probably due in large part to the smaller proportion of parochial 
schools among the participants than among the USOE schools • Of the 43 nonpublic 
participants, 19 (44%) were parochial schools, whereas 88 % of the nonpublic USOE 
schools were church related. 

In terms of common belief, at least, nonpublic-nonparochial schools have 
a higher college-going rate than do parochial schools. Because the number of 
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Table 2 

Geographical Location of Secondary Schools 




^orth Atlantic: Connecticut, Delaware, District of Columbia, Maine, 

Maryland, Massachusetts, New Hampshire, New Jersey, New York, Pennsylvania, 

Rhode Island, Vermont. 

Great Lakes and Plains: Illinois, Indiana, Iowa, Kansas, Michigan, 

Minnesota, Missouri, Nebraska, North Dakota, Ohio, South Dakota, Wisconsin. 

Southeast: Alabama, Arkansas, Florida, Georgia, Kentucky, Louisiana, 

Mississippi, North Carolina, South Carolina, Tennessee, Virginia, West Virginia. 

West and Southwest: Alaska, Arizona, California, Colorado, Hawaii, Idaho, 

Montana, Nevada, New Mexico, Oklahoma, Oregon, Texas, Utah, Washington, Wyoming. 

b USOE Digest of educational statistics , OE - 10024-65. Government Printing 
Office, 1965. Table 97> Number of local basic administrative units and number 
of schools of specified types, by state: 1961-62, pp. 122-125. Secondary 

schools include regular* four-year high schools, junior high schools, senior high 
schools, and junior-senior high schools. 
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Table 3 

Public -Nonpublic Classification of Secondary Schools 

K> 





US0E a 

: 

N 1o 


\ 

! Sample 

N $ 


j — j 

' 1 

Participants 

1 

I N % 

i *, 


\ : 

i 

j Nonparticipants 
N $ 


Nonpublic 
















Parochial 


- 


- 


22 


- 


19 


1 3 


- 


Private, religious 




- 


23 


- 


18 


S 5 


- 


Private, nonreligious 


- 


- 


5 


- 


4 


; 1 


- 


Other 




“ 


2 

1 


- 


2 


: 0 




Total 


4,129 


Ik 


52 


18 


-P- 

ro 


* 9 

i 

i 


9 


Public 


25,350 


86 


234 


82 


143 77 


1 91 

i 


91 


Public and Nonpublic 


29,479 


100 


286 


100 


186 100 


i 

100 


100 


x 2 






4-9 




l4 .5 


2 


00 

q 


df 






1 




1 




1 


P 






-05 




.001 


n 


.s . 


No Response 


- 


- 


15 


- 


1 


14 


- 


Total 


29,479 


- 


301 


- 


187 - . 


114 


- 



a USOE Digest of educational statistics , OE - 10024, Government Printing Office, 
1965. Table 97, Number of basic administrative units and number of schools 
specified by types, by state: 1961-62, p. 122-123- Secondary schools include 

regular four-year high schools, junior high schools, senior high schools and 
junior-senior high schools. 
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nonpublic schools is small, the underrepresentation in parochial schools does 
not create a serious difference between the total parr, ic ip ant rate ( 51 $) and 
the total USOE rate (48$) . It should also be noted that the college-going 
rate probably increased between 1964 (the basis for the USOE report) and 1966 
(when the study sample was drawn) . 

Insert Table 4 about here 

Enrollments . The sample selection procedure used was designed to provide 
a representative sample of students, as well as of schools, through the testing 
of all students. The figures in Table 5 are estimates of grade enrollment. 

Those estimated were arrived at by categorizing the participating and non- 
participating schools according to size of enrollment in 10th and 12th grades. 
The midpoint of each enrollment category was multiplied by the number of schools 
in that category. These figures were summed for each grade. The sums were 
multiplied by the total number of secondary schools in the United States and 
divided by the total number of participating or nonparticipating schools. The 
distribution of students across grade levels for participants was very similar 
to the USOE figures at each grade level, but nonparticipants had larger numbers 
of students. This reflected the tendency of large schools not to participate 
in studies of this kind, presumably because of the greater administrative 
difficulties entailed for them. 

Insert Table 5 about here 

Per pupil expenditures . The schools have been asked to state their total 
instructional budget, excluding capital outlay and building budget, and to 
specify the number of students covered by that budget. Because 

O 
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Table 4 

Percentages of Graduates Going on to College 





usoe (i96o) a 


usoe (1964 ) b 


Part i c i p ant s C 


c 

Nonparticipants 


Public 


-- 


-- 


45 


48 


Nonpv lie 


55 


— 


75 


56 


Total 


-- 


k8 


51 


48 



a USOE Statistics of nonpublic secondary schools, 1960-1961 . 0E-20050 

Government Printing Office, 1961 . 

^USOE Digest of educational statistics. 0E-10024. Government Printing 
Office, 1965- Tabl a 119, Course enrollment and labor force status of 1964 high 
school grades l 6 to 24 years of age in civilian noninstitutional population 
by color, sex, and marital status. 

c Computed by multiplying the percentage of schools in each of four intervals 
of college-going rate by the midpoint of the intervals (see item 6 in School 
Questionnaire, Appendix B) . 
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Table 5 



Enrollment by Grade Level 





US0E b 


Participants 


Nonparticipants 


N 


1o 


N 


i 


N 


% 


Grade 10 


3.3 


.36 


3.5 


.36 


5-1 


• 35 


Grade 11 


3.0 


.33 


3.2 


.33 


4.9 


.33 


Grade 12 


2.8 


.31 


3.0 


.31 


4.7 


• 32 


Totals 


9.1 


1.00 


9-7 


1.00 


14.7 


1.00 



a ln millions . 



b USOE Digest of educational statistics . 0E- 10024- Government 

Printing Office, 1965 . Tables 97 and 13. USOE Statistics 
of public schools, Pall 1964, final report . 0E-20007 Government 
Printing Office, 1964. Table 5 • 
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sample were unable to supply the information in this form at the time it was 
requested, the comparisons here are less reliable than the other data presented. 
The estimated average per pupil expenditures were $5 *e 3 for the sample, and 
either $503 (based on average daily attendance) or $532 (based on average 
daily membership) from USOE (Table 6) . 



Insert Table 6 about here 

Adequacy of the sample . In general, the characteristics of the sample of 
schools participating in the PSAT-AIM norming study seemed to jibe quite well 
with the USOE parameters. Because there were some differences, however, a set 
of norms was constructed by weighting data from sample schools to reflect the 
frequency of each class of school in the USOE population. These weighted norms 
turned out to be so nearly identical with the unweighted norms as to make the 
departure from obtained data supererogatory. Therefore, only the unweighted 
norms have been published. 

To conclude this description of the sample, the procedures and comparisons 
cited here seem to indicate that the sample of participating schools was 
sufficiently representative to warrant generalizations from the findings . 

Data Collection 

An overview of the data collected for phases 1 and 2 of the PSAT-AIM 
study appears in Figure 1. In general, the PSAT and a Student Questionnaire 
were administered to all sophomores, juniors, and seniors (except for students 
absent from school on both the primary and makeup testing dates) in late 

October or early November, 1966. In a few very large schools, however, 

f 

specified proportions of students were systematically selected for testing* 

In addition, AIM was administered to the juniors at all schools, and to the 
sophomores at 11 of the schools. 

O 
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Table; 6 

Per Pupil Expenditures 





Sample 


P art i c ipant s 


Nonparticipants 




N 


1° 


N 


1 ° 


N 


1 ° 


0- 599 


no 


51 


85 


55 


27 


**-5 


it-oo- k-99 


55 


16 


26 


17 


9 


15 


500 - 599 


22 


10 


14 


9 


8 


it 


600 - 699 


15 


7 


1 

! 10 
) 


6 


5 


8 


TOO- 799 


8 


b 


! * 


5 


b 


7 


800 - 899 


b 


2 


! 2 

1 


l 


2 


5 


900 - 999 


5 


1 


1 


l 


2 


5 


iooo-k-999 


18 


8 


15 


10 


5 


5 


5000 + 


1 


0 


l 


0 


- 


- 


Total 


216 


100 


156 


100 


60 


100 


No Response 


85 




51 




5**- 




Total 


501 

? 




187 




lib 





Estimated average 


expenditures : 


a 

Sample 


$5*4-5 


US0E ADA b 


$552 


US0E ADM b 


$505 



Estimated by using midpoint, of 1 each interval > except for 
highest interval where lower bound was used. 

^USOE 196$ fall statistics of public schools . 0E-200Q7 
Government Printing Office , 1966 . Table 12 , pp . 26-27 • 

ADA = expenditure per pupil in average daily attendance. 
ADM = expenditure per pupil in average daily membership . 
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Insert Figure 1 about here 



The second contact with the study sample was made in the fall of 1967. 

At this time the students in 6 of the 11 schools who had originally been tested 
with both PSAT and AIM as sophomores in the fall of 1966 were retested with both 
instruments. Students in the other 5 schools were contacted in the fall of 1968 
and retested with AIM. This test-retest pattern provided the data for determining 
AIM scale reliabilities, including stabilities over one-year I two-year interval 
In order to fulfill phase 3 objectives, Lett — is and return postcards were 
sent in May 1968 to the students who were originally tested as juniors in the 
fall of 1966. Additional communication with thes ;udents was scheduled in 
the spring of 1969. 

Description of Test Instruments and Variables 

The PSAT is a shortened version of the Scholastic Aptitude Test, yielding 
scores for verbal (PSAT-V) and mathematical (PSAT-M) abilities. 

AIM is an interest inventory designed to assess interest in 12 subject 
fields that are commonly included in secondary school curricula: Biology , 

English , Art^ , Mathematics , Social Sciences , Secretarial , Physical Sciences , 
Foreign Languages , Mus i c , Industrial Arts^ , Home Economics , and Business^ . 

There are 16 items for each scale, making a total of 192. Students respond 
to the items, which designate activities representative of the work in each 
field, by indicating "Like," "Indifferent," or "Dislike." 




p 

Names of these AIM scales replace earlier names in order to provide 
more accurate descriptions. 
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Figure 1 



Data Collection: Phases I and II 



October 

1966 



October 

1967 



May 

1968 



October 

1968 



Grade 12 
PSAT 
Ques. 
16,107 



Phase III 



Grade 11 




1 


PSAT 




Ques . i 


Ques . 


\ 


14,402 i 


AIM 


: 7 




15,450 







Phase III 

Follow-up 

Group 



Grade 10 










PSAT 










Ques . 










18,550 










PSAT 




AIM 






Ques . 


> 


409 




— » 


AIM 








AIM 


1,466 








663 







In general, all totals consist of approximately equal 
numbers of males and females who completed all measures 
administered in each grade. 
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The Student Question naire contains a total of .8 items (Appendix A) . 

All forms include 15 questions on socioeconomic status (SES) , curriculum type, 
consistency of curriculum choice, definiteness of vocational plans (PLANS), 
occupational opportunity preference (SCORE A-D) , post- secondary school plans, 
and the number of years of pc st-secondary schooling planned (YRS) . 

The re m ain ing 12 questions vary across 20 different forms, which were 

spiraled throughout the samp'e so that approximate_y 5% of the sample 
took any one form. Sixteen of these forms contain different sets of items 
from Project TALENT Informal on Scales; one includes items concerned with 
none lass room, activities; twe include items requiring a self-rating of interest 
in school .subjects; and one as items requesting ^elf-rated interest in the 
12 subject fields represented in AIM. 

For ease in reference, a glossary of variables included in the study is 
presented in Appendix C. 
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FINDINGS 

This report focuses on findings that pertain to the psychometric 
characteristics of AIM: the s ore distributions and norms, the structure of 
the scales, reliabilities, and evidence of construct validity. A iter publica 
tion will report follow-up data and will discuss predictive validit.es. 

Score Distributions 

G ~3 of the questions we sought to investigate was whether there are sub- 
stantial differences between distributions of AIM scores for students grouped 
in various ways. Since our normative group consisted of approximately 15,500 
grade 11 students who had taken the PSAT, AIM, and a Student Questionnaire, 
we were able to form groups according to sex, ability level, curriculum, and 
socioeconomic status (SES) . PSAT-V score ranges of 20-29, 30-39, and 40-80 
divide the sample approximately into thirds, and define for our purposes the 
groups of Low, Middle, and High ability. An index of SES (Low, Middle, or 
High) was derived from a combination of father's occupational level and 
mother's education (see Figure 2). According to this classification, 13% 
of the juniors were in the high SES category, 47% in the middle, and 40% 
in the low. 



Insert Figure 2 about here 

Students identified their curriculum membership as one of the following: 
Academic or College Preparatory, Agriculture, Business or Commercial, General, 
Home Economics, Vocational or Industrial Arts. Table 7 shows the 

O 
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distributions across cur: of juniors classified by SES and sex. It may 

be noted that the academ: zTiculum attracted the greatest number of boys 

and girls at all SES lerr f Ith a single- exception : more low SES girls chose 

the commercial curriculum 



curt Table 7 about here 

In all, 108 unique - rings were possible (2 sexes X 3 ability levels X 
6 curricula X 3 SES leve_ As expected, some of the groupings have a very 

small number of cases (e< z males in home economics); so frequency distributions 
were compiled only for suc^roups having at least 100 members. There were k2 
such groups, and they included $1% of the total sample* 

Scanning the distributions indicated that grouping on SES was unnecessary. 
While distributions for a number of the scales varied substantially according to 
sex, ability, and curriculum, it seemed reasonable to pool cases from the three 
SES categories. When the 3 SES categories are combined there remain 27 subgroups. 
Separate ■ percentile rank nomas tables have been prepared for each of these 27 
subgroups , as well as for ad 1 males and all females (Appendix D under separate 
cover) . Table I in Appeniiix D can be used to locate relevant norms according to 
sex, ability level, and curriculum. 

As far as interest in school subjects is concerned, it is clear that males 
are different from females. Table 7& shows the rank order of the AIM scales by 
mean score for each sex (pooling all ability levels and curricula)* Industrial 
Arts and Physical Science rank highest for males and lowest for females. Home 
Economics , Secretarial , foreign languages rank jaighest for females and 

rei&xively low for mail.es. es tend to like Mathematics much more than females 

do, and the reverse holds for English . In short, to summarize the difference 
between sexes in academic i.c ' ^est, the rank-difference correlation between the 

two columns of means ”n Table fa Is -.70. 

O 
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io of grand total i 13.1 48.3 38.6 13.0 46.3 40.7 
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Insert Table 7 a about here 



Interest scores also differ somewhat by ability levels (although the 
correlations between PSAT-V and AIM tend to be low, averaging around .05) 
and by curriculum. The effects of these variables often interact with those 
of sex. 

Figures 3, 4, 5, an d 6 illustrate the distinctions between selected AIM 
distributions according to sex, ability, and curriculum. Figure 3 highlights 
the nature of the differences for sex and ability simultaneously , on the AIM 
English scale. As can be seen from the curves representing the distributions 
of scores, the High ability males tend to score higher than the Middle and the 
Low ability males, and the distribution of their scores looks quite similar to 
the distributions for the Low and the Middle ability females . The High ability 
females clearly seem to have much higher interest in English than any of the 
other groups. A glance at the median scores, presented below, for these six 
groups on the English scale reinforces this impression: 

Ability Level 





Low 


Middle 


High 


Males 


10.2 


11.0 


15.8 


Females 


16.2 


17.4 


21.8 



Note that the medians for all the male groups on English were below 16, 
which may be regarded as the ’'indifference" level. (Item responses are scored 
2 for Like, 1 for Indifferent, and 0 for Dislike. There are 16 items per scale.) 




Insert Figures 3, 4, 5 S and 6 about here 
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Table 7 a 

Rank Order of AIM Scales by Mean Score for Each Sex 



Males 

Scale 


Mean 


S.D. 


Females 

Scale Mean 


S.D. 


Industrial Arts 


22.55 


7-95 


Home Economics 


25.35 


6.03 


Physical Sciences 


20.01 


8.95 


Secretarial 


22.39 


8 .36 


Business 


18.22 


8.03 


Foreign Languages 


20.79 


9.67 


Biology 


17-39 


8.54 


Art 


19.76 


8.08 


Social Sciences 


17.34 


9.09 


English 


18.75 


7-95 


Mathematics 


17.09 


9.66 


Business 


18.71 


7-38 


Secretarial 


16.02 


7.46 


Social Sciences 


17.03 


9.03 


Foreign Languages 


14,99 


10.10 


Music 


16.57 


8.63 


Art 


14.83 


8.08 


Biology 


15.68 


8.44 


English 


13.51 


8.12 

| 


Mathematics 

i 


12.86 


9.44 


Music 


13-45 


8.90 


> Physical Sciences 


11.70 


8.96 


Home Economics 


12.61 


7-35 j 


Industrial Arts 

j 

i 


10.96 


8.04 
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COMPARISONS OF SELECTED AIM DISTRIBUTIONS BY SEX AND ABILITY 
(ACROSS ALL CURRICULA AND SES LEVELS) 
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The distributions for the Physical Science scale, as one would uredict, 
show a strikingly different picture (see Figure 4). Median scores for males 
at the High, the Middle, and the Low ability levels are 23.0, 20.0, and 18.0 
(each above 16, the midpoint of the scale or the "indifference" point). The 
medians are 12,0 for the High ability females and 8.5 and 8.8 for the Middle 
and the Low ability females, respectively. 

One might anticipate that on certain AIM scales the High ability group 
would score lower than the Middle and the Low ability groups. This is indeed 
the case. For example, on the Secretarial scale (see Figure 5), the median score 
for the High ability girls is 18.8, for the Middle and the Low ability girls 25.2 
and 27.1, respectively. A similar tendency appears for the boys' medians: 14.0 

for the High ability group, 16.2 and 16.8 for the Middle and the Low. 

As indicated in some of the illustrative data given above, the High ability 
groups on various scales often differ substantially from the Middle and Low 
ability groups, but the differences between Middle and Lour groups are negligible. 
In later norms tables, therefore, we may find it expedient to r» ’uce the number 
of groups further by. pooling Middle and Low ability students. 

Finally, Figure 6 illustrates the differences between median scores 
obtained by various curriculum groups- on several relevant AIM scales. Because 
curriculum tends to vary with sex and (especially) ability, this figure includes 
only the males at the Middle level of ability (and SES) . The median 
circled is the one that should logically be highest for each scale, and in 
every case it Is : the students in a college preparatory curriculum are much 

higher than the others on the Math scale: the students in a Business curriculum 
are much higher than the others on the Sec and Bus scales; and the Industrial 
Arts students are highest on the Ind A rt scale, although here the difference 
is not so striking--all male groups tend to score relatively high on this scale. 
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Scale Structure 

The structure of academic interests of eleventh— grade boys and girls was 
another topic we sought to investigate. Intercorrelations of the 12 AIM 
scales and two ability variables — PSAT-V and M — provided the basis for our 
inquiry . 

3 

Table 8 indicates that the relationships between AIM scales tend to be 
moderate to low. Correlations of .50 or above are found for both males and 
females between (a) Physical Science and Biology , (b) Physical Science and 
Industrial Arts , (c) English and Social Sciences , (d) Business and Secretarial. 
For males only, correlations of .5 or higher are found for (a) English and 
Foreign Language , (b) Business and Social Sciences , (c) Business and Home 
Economics , and (d) English and Music. Similar patterns were found in an earlier 
study of AIM (Halpem, 1967). 

On the whole, the pattern of AIM intercorrelations makes good sense. Even 
without resorting to sophisticated rtatistical analyses, we can begin to identify 
several clusters of academic interests. One such cluster, composed of Biology- 
Physical Science- Industrial Arts might roughly be labeled Science and 
Technology Int erest. Yet another appears as English-Social Sciences- 
Foreign Language-Music , or Liberal Arts Interest . Business -Secret arial 
(and possibly Home Economics) shows up as a third cluster. 

Insert Table 8 about here 



With regard to the relationship between interest and ability, it is en- 
couraging to note that with only one exception (Math and PSAT-M for females) 



3 

AIM scale means and standard deviations in Table 8 differ very slightly from 
those in Table 7 a because of a difference in the samples. Table 8 is based on 
all males and all females who took AIM and the PSAT. Table 7 a is based on the 
slightly smaller norms sample, who also filled out the student questionnaire. 
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Intercorrelations of AIM and PSAT' 
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®Males above the diagonal; females below the diagonal 
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all the AIM-PSAT correlations are below .5. The rather low relationships 
between the AIM scales and PSAT lend support for the justification of an 
interest measure apart from an ability measure. 

Maximum likelihood factor analyses of the intercorrelation matrix for 
boys and for girls helped to sharpen the picture and to corroborate the 
distinctiveness of the interest measures from the ability measures. A five 
factor solution, separately by sex, is presented in Table 9. 

For the girls, a five factor solution appears adequate, for the structure 
is beautifully simple. (Because of the huge sample size, a chi-square test 
cannot be relied upon to give an indication of the appropriate number of factors.) 
Factor I stands out clearly as an Ability factor with AIM having negligible 
loadings on it. One possible exception is Mathematics interest, which, as 
in earlier three and four factor solutions, bears a closer relationship to 
ability than do any of the other interests. Indeed, Mathematics interest, 
which we identify as Factor III, does not emerge as a separate factor previous 
to the five factor solution. Factor II is readily identifiable as Business 
interest. Factor IV as Science interest, and Factor V as Liberal Arts interest. 
Once again, if we look back to earlier solutions, we find that for females, 

Science and Liberal Arts interests bear a close connection to one another, 
while Business interest clearly stands apart. 

The five factor solution for the boys is not quite so clear as it is for 
the girls, giving some indication that a six factor solution may be called for. 
Corresponding to the factors for the females are an Ability factor (I), a 
Business factor (II) , *a Science factor (IV) , and a Liberal Arts factor (V) . 

Factor III, for the males, we have elected to call Nonacademic interest. 

Notice that for the boys Mathematics interest has a sizable loading on both the 
Ability and Science factors and does not emerge as a separate factor. The three 
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and four factor solutions indicate, as in the case for the girls, that Mathematics 



interest stands closer to Ability than do any of the other interests . Science , 
however, emerges early as a separate factor for the boys. 



Insert Table 9 about here 



In view of the vastly disparate score distributions for boys and 
girls on AIM scales, the similarity in structure for both sexes is a bit 
surprising. For, if we assume that boys and girls attach the same meaning to 
their inventory responses (and this assumption is defensible in view of their 
common school experiences) , then the differences in academic interests between 
the sexes appear to be of level and not of kind. 

Internal Consistency and Stability 

Score consistencies and stabilities of AIM scales are of concern for 
theoretical reasons that go beyond the conventional .obligation to report such 
characteristics in any measuring instrument. We had hypothesized that (1) the 
acquisition of academic interests is developmental and experiential in nature, 

(2) these interests are sufficiently well defined by the mid-high school years 
to make their measurement meaningful, and (3) these interests are more fluid- 
less crystallized--than verbal and mathematical, abilities. 

Internal consistency coefficients (alpha) are presented in Table 10. All 
but two are in the .90's. These data are similar to what we find for the PSAT, 
with reported KR-20's for both PSAT-V and PSAT-M in the vicinity of .90 
(ETS, 1967). 

Insert Table 10 about here 

Test-retest stabilities of AIM scales over a three-week interval were found 
in a previous study (Halpern., 1967) to cluster about .86. The current study 
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Table 10 



Internal Consistency Coefficients (Alphas) for AIM Scales 



Grade ll a 



AIM Scales Male Female 



Bio 


.92 


. .91 


Eng. 


.90 


.89 


Art 


.91 


.90 


Math 


• 95 


.95 


Soc Sci 


• 9^ 


.95 


Sec 


CO 

CO 


.92 


P Sci 


.93 


.95 


F Lang 


.96 


.96 


Mus 


.92 


.92 


Ind Art 


.91 


.93 


Home Ec 


.90 


.91 


Bus 


.91 


.90 



a , 

N = 409 students in 5 schools who had been tested in grade 10 
and were retested in grade 11. Alpha coefficients for grades 
10 and 12 are virtually identical with those for grade 11, with 
differences not exceeding .02. 
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incorporated procec ares to determine stabilities over one- and two-year periods. 
A random subsampi-. f 11 schools was selected for this study of stabilities of 
AIM scores. All grade 10 students in each of these schools were given AIM 
along with PSAT and the Student Questionnaire in 1966. The same students in 



approximately half the schools of this group w-re retested with AIM one year 
later, and the other half were retested two years later. 

One- and two-year stability coefficients (test-retest correlations) 
for each of the AIM scales, by sex, are presented in Table 11. For males , 
the one-year stability coefficients range from a low of .60 (Secretarial) 
to a high of .75 ( Mathematics) , with a median r of .71. For the females , 
the range is .64 ( Biology and Industrial Arts) to .77 ( Music) , with a median r 
of .70. The two-year stability coefficients for males range from a low of .52 
( Business) to igh of .74 ( Music) , with a median r of .61. For females , 
the range is .52 ( Business) to .69 ( English) , with a median r of .63. These 
stability coefficients appear consistent with our conceptualization of 
academic interests as somewhat fluid during the mid-high school years. That is, 
they are still likely to be responsive to experience. 



Insert Table 11 about here 



Construct Validities 

From an investigation of the relationships between AIM scales and other 
variables included in the study, we sought to learn more about the nature of 
academic interests and to gain preliminary evidence of AIM's construct validity. 
We hoped to find AIM scales exhibiting moderate positive correlations with each 
of the several sets of relevant variables (relevant in the sense that they 
appear to bear some logical relationship to academic interests) and low or 
slightly negative correlations with variables considered irrelevant to or 
Q distinct from academic interests. The relationships between AIM scales and a 

ERIC 

k iiii iuH iii atn number of such variables are described below. /I O 
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Table 11 



AIM Scale Stability Coefficients 



AIM Scales 


Males 

1-year 2-year 


Females 

1-year 2-year 


Bio 


.71 


.6 3 


. 6 k 


• 6 3 


Eng. 


.69 


. 60 


.73 


.69 


Art 


,73 


.61 


.71 


.68 


Math' 


.75 


. 66 
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.67 


See Sci 


• 73 


• 58 


.68 


. 5 k 


Sec 


. 60 


• 53 


.65 


.63 


P Sci 


.71 


• 83 


.69 


■ 63 


F Lang 


.69 


• 59 


.70 


.61 


Mus 


.73 


.7^ 


• 77 


.68 


Ind Art 


.72 


.70 


. 6 k 


.62 


Home Ec 


. 66 


• 58 


■ 70 


.59 


Bus: 


. 66 


.52 


.67 


.52 
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Self-rated Interest. One form of the Student Questionnaire contained 
12 items, each of which hore a title corresponding to one of the 12 AIM 
scales, as they were then named. Unfortunately, those titles were not in every 
case the same as the names now used for the AIM scales: Art was then called 

Fine Arts, Industrial Arts was called Engineering, and Business was called 
Executive. The changes were made primarily because of the contents of the items 
for these scales, but consideration was also given to correlations between the 
scales and such other variables as are reported in the following sections. It may 
be noted that changing the names of two of the scales to Industrial Arts and 
Business was a return to the original names of these scales in the Interest 
Index originally developed for the Eightwyear Study (Smith § Tyler, 1942). 

The 5% random sample of students who were given this form of the questionnaire 
rated each of the 12 fields of interest on a 5-point scale ranging from 
"very interesting" to "very uninteresting." Correlations between these single 
ratings and AIM scores for males and females are presented in Tables 12a and 12b. 
Each of the AIM scales has its highest correlation (on the diagonal) with a 
•similarly titled field of interest, and in general these correlations can be 
characterized as moderate, with half of them falling in the 40' s. 

Insert Tables 12a and 12b about here 



A few exceptions to this moderate relationship between AIM scales and self- 
ratings may be noted. 1 When the relationship is as high as in the area of 
Mathematics interest (for both males and females the correlation between the 
two measures is around .7), the efficiency of the single direct question poses 
a challenge to the 16-item scale. The acid test will come shortly when we 
look at the predictive validities of both these measures. Until then, we feel 
some assurance that the scales seem to be measuring what they purport to 
O 
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Correlations between AIM, PSAT and Self-rated Interest 
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Correlations between AIM, PSAT and Self-rated Interest 
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measure and that almost all of them provide information relevant or otherwise) 
that is somewhat different from a single rating of interest in an area. Another dif- 
ference that may be worth noting is the pattern of mean scores on self-rated 
interests. The AIM means, as indicated in Table 8, show males below the "in- 
difference level" (16) in Eng , Art , F Lang, Mus and Home Ec . The AIM means for 
females are below 16 in Bio , Math , P Sci, and I nd Art . 

Means on the self-ratings of interests in these subject fields (Tables 12a 
and 12b) seem consistently to exceed the "indifference level" (a score of 3 on a 
5-point scale) For the males, ratings of interest in Secretarial, Foreign 

Language, and Home Economics fields fall below 3.00. For the females, only the 
mean rating on Industrial Arts is below this "indifference, level." Even more 
remarkable is the very high rating given to interest in Biology. The mean ratings 
by both males and females place Biology at a higher level of interest than any 
other field. Yet the AIM means for Biology (Table 8) are 17.30 for males and 
15.58 for females. We have no convincing explanation for these phenomena. That 
they are not attributable to sampling error is borne out later, in the discussion 
of Tables 18a and 18b. 

S ex, Ability, SES, and Other Variables . Sex, ability level, and curriculum 
membership clear ly bear a logical relationship to academic interests . In our 
previous discussion of AIM scale score distributions it was pointed out that sex 
and ability level, but not SES, affect AIM distributions. Further indication of 
these relationships is provided by the correlations in Tables 13a and 13b. For 
males, the highest correlation found between any AIM scale and SES (as defined in 
Figure 2) was . 1^4- (SES and Social Sciences ) and for females the highest correla- 
tion found was -.26 (SES and Secretarial ) . These low correlations, in conjunc- 
tion with the AIM distributions, support the conclusion that AIM scales are 
virtually independent of SES. This is a somewhat unexpected but welcome finding, 
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for it allows guidance counselors to make normative interpretations of a stu- 
dent's AIM scores without inquiring about the educational and occupational 
status of his parents. 

The relationships between interests and ability exhibit a, greater 
complexity. For many of the .AIM scales we find only slight differences 
between distributions for students grouped according to ability level, and the 
AIM-PSAT correlations also tend to be low. (See Table 8.) In other words, we can say 
that some academic • interests appear to be independent of ability. In other instances, 
as in the case of AIM English , we find considerable differences between the 
scale score distributions for the High and the Middle or Low ability groups 
(see Figure 3), as well as correlations of .27 and .28 with PSAT-V. 

Two other variables derived from the Student Questionnaire, "Definiteness 
of vocational plans" (item 6, labeled PLANS) and "Curriculum consistency" 

(based on items 4 and 5, labeled Cur C) fail to show any evidence of a linear 
relationship with AIM scales (see Tables 13a and 13b) , A third set of variables, 
concerned with "Occupational opportu?iities" (scores A - D, Table 13a and 13b) 
exhibit low to moderate correlations with AIM scales. Since these item scores 
are not independent, being based on rankings, the overall pattern is difficult 
to interpret. In view of the absence of any sizable positive correlations, 
however, it seems safe to infer a lack of positive linear relationship between 
AIM and (A) opportunity to work with ideas, (B) opportunity to work with people, 

(C) opportunity to work with things, and (D) opportunity to be a leader. 

("Ideas," "people," and "things" will be recognized as the three interest areas 
according to w’nich occupations are charact arized in the Dictionary of Occupational 
Titles. ) 
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For both males and females, the number of years of post-second a ry 
schooling planned (item 28, labeled YRS) exhibits moderate positive correlations 

with PSAT-V and PSAT-M and slightly lower correlations with four AIM scales 

Mathematics , Social Sciences , Physical Science and Foreign Language — all of 
which represent subjects usually required by liberal arts colleges. For 
males only , a correlation of similar magnitude is also found between this 
variable and English. For females only, a somewhat larger negative correlation 
is also found between this variable and AIM Secretarial (r = -.35). Again, 
this pattern of relationships seems logically consistent. 

Insert Tables 13a and 13t> afaout here 



Project TA LENT Information Scales . Of the 20 spiraled forms of the 
Student Questionnaire, l0 contained 11 to 12 items from subscales of Project 
TALENT Information tests. 

Once again we hoped to find AIM scales relating more highly with corres- 
ponding information areas than with less similar areas. In addition, we 
expected to find the information-interest correlations generally low--specifically 
lower than the correlations between information and ability scores. 

The correlations of , -M scales with the information -ales derived from 
Project TALENT (Tables 14a and 14b) are , for the most part, as low as we • 
had anticipated. For males, the highest positive correlation was for Mathematics 
Information with AIM M athematics (r = .36); for females, the highest positive 
correlations were for Social Studies Information with AIM Social Scie^ es and 
for Physical Science Information with AIM Foreign Langua ge (r = ,28). 



Table 13a 



Correlations between AIM, PSAT, and Several Student 
Questionnaire Variables 
(Males ) 



AIM 



Scales 


SES 


PLANS 


YRS 


Score A 


Score B 


Score C 


Score D 


Cur C 


Bio 


-.01 


.06 


.12 


.07 


- .03 


-.01 


-.03 


-.01 


Eng 


. 12 


.08 


.28 


.13 


.08 


-.31 


. 14 


.06 


Art 


-.04 


.04 


.01 


.05 


.00 


-.02 


-.05 


-.05 


Math 


.07 


.05 


.26 


.21 


-.10 


-.11 


.00 


.14 


Soc Sci 


.14 


.05 


.25 


.09 


.08 


-.29 


.14 


.07 


Sec 


-.08 


-.03 


-.05 


-.11 


.12 


-.09 


. 10 


-.07 


P Sci 


.06 


.06 


.20 


.21 


-.14 


-.04 


-.04 


.08 


F Lang 


.05 


.05 


.23 


.09 


.08 


-.22 


.08 


.02 


Mus 


.01 


.08 


.19 


.06 


.06 


-.15 


.05 


-.02 


Ind Art 


-.09 


.04 


-.08 


.02 


-.14 


.20 


-.10 


.00 


Home Ec 


-.08 


.03 


-.02 


-.04 


.05 


-.04 


.03 


-.07 


Bus 


.03 


.01 


. 12 


-.01 


.11 


-.23 


.16 


.02 


PSAT-V 


.37 


.05 


.44 


.26 


-.09 


-.17 


.00 


.35 


PSAT-M 


.35 


.04 


.44 


.'25 


-.10 


-.13 


-.02 


.37 


Mean 


3.01 


2.61 


2.96 


2.39 


2.99 


2.46 


2.17 


4.18 


S.D. 


1.28 


1.13 


.82 


1.05 


.96 


1 .16 


1.12 


1.19 
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Table 13b 

Correlations between AIM, PSAT, and Several Student 
Questionnaire Variables 
(Females ) 



AIM 

Scales 


SES 


PLANS 


YRS 


Score A 


Score B 


Score C 


Score D 


Cur C 


Bio 


.03 


.06 


.19 


. 10 


-.08 


-.04 


-.01 


.02 


Eng 


. 13 


.11 


. 13 


. 12 


.00 


-.23 


.12 


.09 


Art 


.09 


.03 


.09 


.06 


-.07 


-.02 


.01 


.04 


Math 


.01 


.04 


.23 


. 13 


-.07 


-.10 


.02 


.05 


Soc Sci 


.10 


.07 


.25 


.14 


.00 


-.20 


.07 


.07 


Sec 


-.26 


.02 


-.35 


-.16 


.05 


.09 


.02 


-.16 


P Sci 


.04 


.05 


.25 


.18 


-.12 


-.09 


. GO 


.03 


F Lang 


.08 


.08 


.26 


.07 


.00 


-.16 


.09 


.09 


Mus 


.07 


.08 


.19 


.07 


-.02 


-.11 


.06 


.03 


Ind Art 


.02 


.01 


.08 


.05 


-.11 


.04 


-.02 


-.02 


Home Ec 


-.15 


.07 


-.16 


-.08 


.06 


.03 


.01 


-.08 


Bus 


-.16 


.07 


-.16 


-.04 


.01 


-.04 


.07 


-.10 


PSAT-V 


.38 


.02 


.40 


.12 


-.01 


-.10 


-.01 


.35 


PSAT-M 


.35 


.01 


.39 


. 12 


-.03 


-.08 


-.01 


.33 


Mean 


2.96 


2.90 


2.70 


2.33 


3.71 


2.13 


1.82 


4.24 


S.D. 


1.31 


1.05 


.75 


.89 


.61 


.94 


.93 


1.12 
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Insert Tables lk a and lkb about here 



In spite of the low relationship between the AIM scales and the Information 
scales, AIM generally correlates more highly with appropriate Information areas 
than with inappropriate areas. A summary of these relationships is presented 
in Table 15. 



Insert Table 15 about here 



Correlations between the Project TALENT Information scales and PSAT 
(Tables ika. and Ik-b) are generally in the moderate to high range (median cor- 
relation is about .6 with PSAT-V and about -5 with PSAT-M), while correlations 
between AIM scales and PSAT are generally low. It is particularly noteworthy 
that even the nonacademic information scales show substantial relationships 
with PSAT. These relationships provide evidence that AIM is more nearly independent 
.,2 measured ability than an information test. They corroborate a similar 
finding by Skager, Bussis and Schultz (l9f"5) that other information tests 
overlapped with ability to a much greater extent than AIM did. 

Nonclassroom Activities . The pattern of relationships between AIM 
scales and scores based on frequency of participation in an array of non- 
classroom activities adds yet another brick in building up the foundation of 
AIM's construct validity (see Tables 16a and 16b). - Once again, we find AIM 



Correlations between AIM, PSAT and Project TALENT Information Scales 
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Table 15 

Correlations between AIM Scales and Information Scales 



AIM Correlation with Similarly Titled 

Scales Project TALENT Information Scale 







Males 


Femal < 


Bio 


Biology 


. 16 


. 13 


Eng 


Literature 


. 14 


.27 


Art 


Art 


. 16 


. 22 


Math 


Mathematics 


. 36 


. 26 


Soc Sci 


Social Studies 


.30 


.28 


P Sci 


Physical Science 


. 28 


. 20 


Mus 


Music 


. 17 


. 18 


Ind Art 


Mechani cs 


.13 


.05 


Home Ec 


Home Economics 


.02 


.01 




r~ rr 
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Insert Tables 16a and 16b about here 

generally exhibiting near zero correlations with inappropriate activities and 
somewhat higher to moderate correlations with activities logically related 
to each scale. A summary of these relationships is outlined in Table 17. 

Insert Table 17 about here 

None of the activities correlates with PSAT greater than .20 for both 
males and females, although for the males one activity--sewing--has a correlation 
with PSAT-V of -.22. 

Parenthetically, the mean scores for the activities (presented in next to 
the last row of Tables 16a and 16b) suggest that none of the 12 nonclassroom 
activities listed is notably popular. For the males, only one has a mean value of 
> 3.0 (corresponding to the participation response category "occasionally")? and 
that activity is "raising or caring for animals or pets." For the females, two 
activities have a mean value of > 3.0--caring for pets and cooking. These data 
indicate that students spend little time outside of school participating ir; the 
hobbies or leisure time activities included in the questionnaire. 

S pecific School Subject s. Two of the 20 different forms of the 
Student Questionnaire contained an array of specific school subjects for which 
students were to indicate their level of interest. Correlations between all of these 
school subjects and AIM scales are found in Tables 18a and 18b. 



Insert Tables 18a 8b about here 

Table 19 selects some of these correlations to highlight relationships between 
AIM scales and subjects which seem logically relevant to them. In general, the scale 
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Table 17 

Correlations between AIM Scales and Nonclassroora Acbi-vi'bies 



AIM Scales 



Bio. 

Eng. 

Art 

Math 
P Sci 

F Lang 
Mus 

Xnd Art 
Home Be 



Activity Correlating Highest with AIM ( > - ,20] 



Males 

Gardening (.22) 

Doing Word Puzzles (.24) 
Drawing (.53) 

Doing Word Puzzles (.26) 

Auto Repair (-.24) 
Drawing (.23) 

Elec, Equip. (.37) 
Cooking ( , 38) 



Females 

Raising Pets C*24) 
Gardening (.23) 
Drawing (.57) 



Collecting Stamps (.21) 

Gardening (.25) 

Elec. Equip. (.29) 
Cooking t. 36) 
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The scale runs from 2-5, with the score 1 indicating "Have never taken a course in this subject.’ 1 Therefore 
score of 3.5 represents the indifference level. 
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The scale runs from 2-5, with the score 1 indicating "Have never taken a course in this subject." Therefore 
score of 3.5 represents the indifference level. 
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for each field appears to be about equally correlated with the various subjects in 
that field. For example, the Mathematics scale correlations with Algebra, Trigonometry, 
and Geometry are all quite high , and the Social Science scale yields correlations with 
European History, Civics, and American History that are all in the .40' s. Thus each 
scale seems to be about equally representative of most of the subjects generally 
classified in its field. 

Insert Table 19 about here 

The forms of the questionnaire (coded D3 and D4) which provided data for Tables 
18 and 19 may seem redundant, since another form of the questionnaire (coded D5) 
obtained students' self-rated interests in the fields purportedly represented 
by AIM scales , 

Differences between these forms of the questionnaire are, however, worth 
noting. Form D5 (which provided data for the correlations reported in Tables 
12a and 12b) asked students to indicate interest in a field even if they had not 
taken any course in that field (see Appendix A, D5, page 3: "If there are fields 

with which you are not familiar, answer according to whether you would like to 
take a course in them.") A five-point response scale was used, ranging from 
"Very interesting" (3) to "Very uninteresting' (1) . As mentioned in connection with 
Tables 12a and 12b, the items corresponded to the titles then in use for the AIM 
scales, and were designated as "fields of study." 

Form D3 and D4, on the other hand, appeared to ask about interest in school 
subjects actually taken, since the five response options included a four- point 
scale ranging from "Very interesting" (5) to "Not interesting at all" (2) , along 
with the option. "Have never taken a course in this subject" (scored 1, but of 
course deleted from the computation of correlations). The items in D3 and D4, 
as indicated in Tables 18 and 19, were usually more specific course titles rather 
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Table 19 

Correlations between AIM Scales and Self-rated Interest in 

Similar Subjects 



AIM 

Scales 


School 
Subject (s) 










Males 


Females 


Bio 


Biology 


.41 


,44 




General Science 


.32 


.42 


Eng 


English (D3) 


.47 


.42 




English (D4) 


.41 


.43 


Art 


Art Appreciation 


.58 


.67 


Math 


Algebra 


,64 


.58 




Trigonometry 


.60 


.75 




Geometry 


.58 


.62 




Business Arithmetic 


.34 


.42 


Soc Sci 


European History 


.46 


.41 




Civics 


.42 


.44 




American History 


.42 


.43 




Social Sciences 


,37 


.32 


Sec 


Bookkeeping 


.49 


.57 




Retailing 


.40 


.40 




Typing 


.30 


.35 




Shorthand 


,07 


.15 


P Sci 


Chemistry 


.54 


.41 




Physics 


.53 


.30 




Earth Science 


.39 


.44 




General Science 


.38 


.49 


F Lang 


French 


.50 


.48 




Spanish 


.45 


.45 


Mus 


Music Appreciation 


.61 


.58 


Ind Art 


Shop 


.45 


-.07 


Bus 


Retailing 


.35 


.54 




Bookkeeping 


,41 


.43 
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than the field titles used in D5-=for example. Physics * Chemistry, Earth 
Science, and General Science appear as items in D3 and D4, compared with 
the item Physical Science in D5, ^ 

These differences between the questionnaire forms notwithstanding, 
the mean ratings of interest in subjects seem to follow the same pattern 
as the mean ratings of interest in fields of study. Since the means in 
Tables 18a and 18b represent ratings by students who had actually taken the 
subjects rated, we may expect some effect attributable to self-selection in 
some of the subjects* Indeed, the only means that fall below the "indifference 
level ft (in this case, 5,5) are Spanish and Shorthand for males. Again, as in 
Tables 12a and 12b, the mean ratings for Biology suggest that it is regarded 
as one of the most interesting subjects by males and females alike. Since 
questionnaire forms D5 (which provided the data for Tables 12a and 12b) and D3 
(which provided the data for Tables 18a and 18b) were filled out by different 
5% samples of the study population, it is difficult to avoid the inference that the 
AIM Biology scale is in some respects not an adequate representation of Biology 
interest as perceived by high school juniors. Despite the usual moderate level 
of correlations between the Biology scale and ratings of interest in Biology, 
the scale items seem to be distinctly less popular than the global ratings 
would lead us to expect. 

The pattern of correlations in Tables 18 and 19 is also quite similar to 
those presented in Tables 12a and 12b, Earlier, in discussing Tables 12a and 
12b, we raised the question of pitting each 16-item AIM scale against a single 
question about interest in the field represented by that scale. Certainly, the 
relative economy of a one-item scale is desirable, if relevant information 
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is not sacrificed (ef_. Pinsleur, 1963 , who discarded a 20-item foreign 
language interest inventory in favor of a five-point rating on a single question) 
This comparison between one-item ratings and 16-item scales will he pursued 
assiduously in a forthcoming publication on predictive validities. 

In the meantime, it seems reasonable to hypothesize that items like those 
in AIM- - straightforward statements of activities commonly encountered in various 
subject fields in high school--cannot be expected to provide a "better" measure 
of a student’s interest in a field than the student's rating of interest, pro- 
vided the student has had representative experience in that field. For exanrale, 
if a student has taken several years of French, one hardly needs an array of 16 
items, such as "To speak a foreign language," "To write in a foreign language," 
and "To learn the grammar of a foreign language," in order to help him assess his 
interest in French. It should suffice to ask him, once, to rate his degree of 
interest in the experience. Of course, his experience may or may not be repre- 
sentative, Yet such a rating would probably be the best criterion by which to 
judge the predictive validity of an academic interest inventory administered 
prior to his exposure to the course. The correlations between appropriate AIM 
scales and Art Appreciation, Algebra, Trigonometry, Geometry, and Music Appre- 
ciation are around ,6 for males and females, but most of the other correlations 
fall in the ,40's (Table 19), In a prediction study, correlations of such a magni- 
tude would seem to suggest quite impressive validity for AIM. Table 19, however, 
represents concurrent validity, since AIM and the ratings were filled out at about 
the same time. These correlations, then, may be regarded as an upper bound on what 
may be expected from AIM in the prediction of interest in various subjects at the 
high school level. One must expect still lower validities in predicting interest 
in college courses. 



O 

ERIC 



67 



-64- 



SUMMARY AND DISCUSSION 

In the fall of 1966, juniors in a national sample of secondary schools 
completed answer sheets for the Academic Interest Measures (AIM) , the Preliminary 
Scholastic Aptitude Test (PSAT) , and an extensive questionnaire. Major purposes 
were to compile norms for PSAT (previously published) and for AIM (Appendix D) , 
to examine the structure of the AIM scales and their relationships with other 
variables, to calculate reliability coefficients for AIM, and to lay the ground- 
work for studies of predictive validity reaching through grade 12 and the follow- 
ing year. At the same time, sophomores in 11 of the schools also took AIM. They 
were retested one year later in five of these schools, and two years later in 
the other six schools, in order to obtain coefficients of stability for AIM over 
one-year and two-year intervals. 

Statistics for the sample of secondary schools were compared with data on 
the population of secondary schools published by the U. S. Office of Education, such 
as geographical location, proportion of public schools, college-going rates, size 
of enrollments, and instructional expenditures. Although the USOE population data 
were compiled several years before 1966, the characteristics of the sample 
appeared to jibe quite well with the USOE parameters. Indeed, norms weighted 
to reflect the frequency of each category of school in the USOE population turned 
out to be virtually indistinguishable from unweighted norms based directly on the 
data obtained from the sample. In short, the sample of participating schools 
seemed sufficiently representative to warrant generalizations from the findings. 

The total norms group for AIM consists of about 15,5 thousand juniors, 
almost equally divided between males and females, who completed all measures 
administered in grade 11. The size of this group permitted subgroupings 
according to sex, ability, curriculum, and socioeconomic status (SES) , While 
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distributions for a number of the AIM scales varied markedly according to sex, 
al ' 11 i.y , and curriculum, SES was found to have no substantial effect. Pooling 
the three SES categories and eliminating all subgroups with fewer than 100 
members reduced the number of norms subgroups to 30. Effects of ability 
could be distinguished mainly between High ability on the one hand (the upper 
third of the sample, defined by PSAT-V score range 40-80 ) and Low and Middle 
ability on the other hand (the lower two-thirds, defined by PSAT-V score 
ranges of 20-29 aad 50-39 , respectively). It may, therefore, be expedient 
in the future to reduce the number of norms groups further by pooling Middle 
and Low ability students . 

In general, the AIM scales seem to represent a domain quite distinct from 
academic ability as defined by the PSAT. Correlations between AIM and PSAT 
tend to be quite low, the most noteworthy exception being the correlation of 
.52 between AIM Mathematics and PSAT-M for females . The next highest AIM-PSAT 
correlation is ,39 between the same two variables for males. The only other 
correlation between an AIM scale and PSAT to reach as high as >3 is the nega- 
tive relationship between AIM Secretarial and PSAT-V for females (-.34). 

The relationships among AIM scales are generally moderate to low, tending 
to define such logical clusters as science and technology interest and liberal 
arts interest. High correlations between the Secretarial and Business scales 
for both sexos (about .?) suggest that these scales might well be merged into 
a single Business scale, especially since the Secretarial scale correlates 
higher with students * ratings of interest in Bookkeeping and- in Retailing than in 
Typing and in Shorthand (Table 19)* This, however, would reverse the decision 
made by French (1964b) , when he found that sex differences were confounding 
the item analyses for the single Business scale in the Interest Index; he then 
expanded two clusters of items into the scales he called Secretarial and Executive . 

The structure of academic interests seems remarkably similar for males and 

O 
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provides a very clear and simple structure for females. The factors 
are readily identified as Ability and four interest factors -- Business > 
Mathematics ^ Science , and Liberal Arts . The structure for males is almost- - 
but not qui te--identical with that found for females. Ability and the 
interest factors Business g S cience , and Liberal Arts emerge again quite 
distinctively, but both the Ability and Science factors load somewhat on 
the Mathematics interest scale: Mathematics interest does not appear as a 
separate factor, A factor that loads on AIM Art , Music , Industrial Arts , 
and Home Economics does appear for the males, and we have called it Non- 
academic interest. The strong similarity in structure of interests for males 
and females is especially noteworthy in view of the great disparities between 
the sexes in score distributions on the AIM scales. 

Internal consistencies (coefficient alpha) of the AIM scales in grades 10, 
11, and 12 are quite high (about # 9) , Three-week test-retest stabilities 
cluster around. .86 , but one-year stabilities fall off to about ,7, and two- 
year stabilities drop to about ,6. 

From these data on structure and reliability, it seems plausible to infer 
that the AIM scales measure quite meaningful dimensions in a distinctive do- 
main and that academic interests as measured by AIM are still somewhat fluid 
in 10th grade. Thus the measures may be regarded as sensitive to additional 
academic experience , 

In general, AIM relationships with other variables in the student 
questionnaires are consistent with the kind of content that each scale purports 
to incorporate. AIM scales tend to have moderate correlations with students 1 
ratings of their own interests in fields and specific subjects logically corres- 
ponding to the AIM scales * and markedly lower correlations with ratings of 
other fields and subjects. Some unexplained differences are found between 
the level of AIM means for the Biology scale and students 1 mean ratings of 
interest in Biology. AIM means are near the "indifference level," whereas 




0 ratings of interest in Biology are very high. This is the most striking 
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Instance of a general tendency for ratings to suggest greater interest in 
fields and subjects than AIM scores might suggest. 

AIM scales appear to he essentially uncorrelated with detiniteness of 
occupational plans, with curriculum consistency (the latter is moderately 
related to PSAT scores), or with preferences fo- opportunity to work with 
ideas, people, things (the interest rubrics used in the Diction ary of Occupa- 
bional Titles) or to be a leader. Years of post- secondary education planned 
field moderate correlations with PSAT and slightly lower correlations with 
MM scales that represent subjects usually required by liberal arts colleges-- 
ylabh emetics , Scclal Sciences , Physical Sciences , Foreign Language , and 
(for males) English . 

Although groups of items borrowed from Project TALENT Information scales 
field genera lly low correlations with AIM, "appropriate” relationships are 
consistently higher than "inappropriate" ones. The Information scales (even 
the nonacademic ones) are much more highly correlated with PSAT, suggesting 
that they are closer to the ability than to the interest domain, at least in 
a sample of high school juniors. Previous attempts to measure interests by 
means of information tests have produced similar findings . AIM scales also 
show higher correlations with frequency of participation in nonclassroom 
activities that logically seem "appropriate" than with logically 
"inappropriate" ones. 

In general, then, the psychometric properties and evidence for construct 
validity of AIM suggest that it may function well (as its forebear did in the 
Eight-Year Study) as a criterion measure. The Interest Index was developed 
and used for the Eight-Year Study (Smith & Tyler, 19^2) primarily "to 
evaluate interests as objectives— as outcomes rather than as starting points 
of the educative process." A major concern in that study was to compare 
effects of different types of curricula. One such effect was the range and 

magnitude o£ students 1 interests . 71 
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Criteria in addition to achievement are currently again receiving a 
great deal of attention in evaluating educational treatments. AIM has a number 
of advantages for such use as a criterion: national norms for 11th grade, with 

various subgroupings; a clearly defined structure, independent of ability; 
high coefficients of internal consistency and short-term stability, but sensi- 
tivity to change over one-year and two-year periods; and considerable evidence 
of construct validity. The major counterindicat I on is the finding that concurrent 
validities — correlations between AIM scales and students ' ratings of interest in 
subjects actually taken — are often only of moderate size. (The discrepancy 
between mean scores on AIM Biology and the students' high rating of Biology Is 
also troublesome here. One possible interpretation of this discrepancy would be 
to question whether the AIM Biology scale is up-to-date. Perhaps the items do 
not describe current activities in Biology courses, although moderately correlated 
with them, ) 

This one counterindication for use of AIM as a criterion instrument may of 
course also loom as a threat to its predictive validity. We had theorized 
that representative experience in a field should serve as the best predictor of 
later interest in a course in that field. Certainly, reacting to the interest 
inventory items seems like an inferior substitute for that experience. Furthermore, 
the length of most interest scales and the dullness of the items make them tedious 
to the respondent. For many students, the classification scheme for the items is 
transparent , and such students may resent the Pecksniff ian interrogation that 
requires them to respond 16 times per scale instead of once. So the single 
question and rating should suffice for the student who has had adequate and 
representative experience. If, however, a student has had insufficient oppor- 
tunity to acquaint himself with a field, a good inventory should serve as a 
better predictor than a single question and rating. The scale might then 

function as a concise verbal tryout of activities that characterize the 
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field. At best, then, AIM validities for the ''inexperienced" student might 
approach the validities of the rating for the "experienced" student. But 
the lack of consistently high concurrent correlations between AIM scales 
and ratings of interest in subjects actually taken leaves us with a gnawing 
doubt about the efficacy of some of the scales as adequate "miniaturizations" 
of course experience. Perhaps rating on a single question will often suffice, 
regardless of previous experience. Perhaps even students who have not taken 
a course in a given field absorb enough of a notion about that field (by the 
time they reach 11th grade) to sense their interest in it as well as AIM can 
measure it. These speculations anticipate the shape of the analyses in the 
studies of predictive validity, to be published in a forthcoming report. 
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Appendix C 

Glossary of Variables 





Glossary of Variables 



Ability Variables (PSAT Scores) 

PSAT-V • Verbal PSAT-M: Mathematical 

Interest Inventory Variables (Scores on AIM Scales) 



Bio : 


Biology 


Soc Sci: Social 


Sciences 


Mus : Music 


Eng: 


English 


Sec: Secretarial 


Ind Art : 


Industrial Art 


Art: 


Art 


P Sci: Physical 


Science 


Home Ec : 


Home Economics 


Math : 


Mathematics 


F Lang : Foreign 


Language 


Bus: Business 



Student Questionnaire Variables 

SES : Socioeconomic level derived from father's occupation and mother's 

education (Figure 2) 

Cur Type: One of six curricula named by student as best describing his 

curriculum 

Cur C: Curriculum consistency score based on consistency of curriculum 

membership in grades 10 , 11, and 12 

PLANS: Definiteness of vocational plans 

SCORE A-D: Scores based on ranking of four kinds of occupational 

opportunities-- (A) Opportunity to work with ideas and 
theories, (8) Opportunity to work with people, (C) 

Opportunity to work with objects and things, (Dj 
Opportunity to be a leader 

YRS: Number of years of post- secondary school education planned 

Project TALENT Information Tests: Scores on no more than 12 items randomly 

selected from subscales of Part I and Part II of the following Project TALENT 
Information tests: 

Literature . Mathematics Home Economics 

Music Physical Science Mechanics 

Social Studies Electricity Art 

Biology 
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Glossary of Variables (eont'd) 



Activities: Rating of frf Money of participation in the following 

activities : 



Drawing 
Collecting 
Model Building 
Photography 
Self-rating of Interest: 
Physics 
Chemistry 
Biology 
Algebra 
French 

Art Appreciation 



Making Electrical Equipment 

Woodworking 

Raising Pets 



Cooking 

Auto Repair 

Gardening 

Doing Word Puzzles 

school subjects: 

Music Appreciation 

Trigonometry 

English (B) 



Sewing 

In the following specific 



Bookkeeping Earth Science 

English (A) Spanish 

European History Typing 
Shop American History General "cience 

Retailing Geometry Civics 

Social Science Business Arithmetic Shorthand 



SI: Self-rated interests in the 12 subject field titles corresponding to 

the AIM scale titles 
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APPENDIX D* 

Grade 11 Norms for the Academic Interest Measures 



& 

Published under separate cover. Copies are 
available from the author upon request. 
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APIENDIX E 

A Be If -Scoring Form of AIM 
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A Self-Scoring Form of AIM 
Paul B. Biederieh 

When the writer had to use AIM (Academic Interest Measures) as one measure 
of the outcomes of an experimental study in 1966, he was shocked at the cost of 
scoring ? which at that time was $1*15 per student , owing to the number of passes 
through the scoring machine needed to get the twelve basic scores. This figure 
must not be taken as the present cost, since improvements in the scoring machine 
enable it to nandie multiple scores more efficiently, but the cost of machine 
scoring is bound to remain high— possibly high enough to limit the use of this 
instrument to experimental studies supported by a research grant. Furthermore, 
it took three weeks to get the scores, and then they were merely raw scores 
which had to be interpreted by looking up each one in voluminous tables of norms* 
This took so much time that the writer concluded that the instrument would never 
be used routinely to measure the effect of various course improvements on student 
interests unless a way were found to get interpretable scores immediately, and 
preferably by student scoring at no visible cost. Since students can see no point 
in faking scores on this instrument, it was felt that student scoring would be 
as accurate as it needed to be for the purposes for which this instrument would 
ordinarily be used. 

As previously explained, the AIM test booklet lists 192 activities representing 
twelve fields of study. These were retyped in a different order such that each 
field is represented in every twelfth 1 ’em rather than in every fourth. Since 
it was possible to type 24 activities on each page, each field is represented 
twice on each page or 16 times in all. To get student responses to these items 
to lie in two lines across the answer sheet, the activities on each page were 
lettered from A to X, Hence all activities representing English, for example, 
are marked in lines A and M; all those representing Social Studies in lines 
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B and N# The stun of the responses marked in these two lines ought to represent 
the relative amount of interest expressed in these fields. Hence it was decided 
to have students mark each activity as follows: 

2 - If you like it or think you would like it; 

1 - if you don’t know or don T t care one way or the other; 

0 — if you dislike it or think you would dislike it. 

These numbers replace L (like) * I (indifferent) , and D (dislike) in the standard 
form of the instrument* which are converted by the scoring machine into the numbers 
given above; but in the self-scoring form* it would obviously save one step to 
have students use these numbers directly. The directions to students are such 
that the responses mean the same thing no matter whether the numbers or letters 
are used; hence the norms established for the standard form are equally applicable 
to the self-scoring form. The items are identical except for the different order* 
and Halpern (1968) found that the revised order had no significant effect on 
scores; more exactly* no significant effect on inter-item correlations within 
fields” the only way in which scores were like iy to be affected. 

What this all amounts to may be seen most clearly by a glance at the self- 
scoring answer sheet reproduced on the next page as filled in by a 
student* Tom Sample. Note that responses to the activities typed on each page 
of the test booklet are marked in one coliman of boxes on the answer sheet* and 
that the 24 activities on each page are always lettered A through X, Hence the 
activities representing each field always have the same two letters* such as A 
and M for English. The result is that* although the activities seem to be 
arranged in a random order* those representing each field lie in two lines across 
the answer sheet. The sum of the numbers written by the student in these two lines 
corresponds to the relative amount of interest he has expressed in that field. 
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ACADEMIC INTEREST MEASURES (AIM) , Self-Scoring Form, Educational Testing Service 



N am e WT j €. T e ache r _® a te . 

In the box corresponding to each activity (below at the left) write 
2 — if you like it or think you would like it; 

1 -- if you don’t know or don't care one way or the other; 

0 - if you dislike it or think you would dislike it. 








1 l 2 


3 


4 


19 - ^ 

5 


6 


7 1 


8 


A 


a 


/ 


o 


/ 


z 


z 


0 


a 


B 


/ 


/ 


l 


z 


a 


o 




z 


C 


0 


o 


o 


o 


t 


o 


O 


a 


D 


0 


o 


o 


o 


o 


o 


O 


O 


E 


z 


) 


/ 


o 


0 


o 


o 


0 


F 


\ 


o 


/ 


a 


0 


/ 


0 


z 


G 


a 


z 


a 


z 


i 


/ 


/ 


z 


H 


/ 


i 


a 


/ 


o 


O 


z 


/ 


r 


0 


o 




A 


i 


x. 


a 


SL 


j 


-2. 


z 


c 


/ 


/ 


o 


a 


/ 


K 


Z 


*> 


* s 


4 


/ 


i 


* 

A 


a- 


L 






% 

j 


J 




•*.v 


a 


a. 


M 


* 


j 

4' 




f 


z 


A 


a. 


z 


N 


l 


-“ ! 1 




¥ 






W- 8 


-I 


0_ 


a 


o 


o 


f . 


c 


f m v» 


a 


/ 


P 


i 


z 


a 


z 


X./ 


** 


fts 

K 


a 


Q 


z 


a. 


/ 


Q 


i 


0 


/ 


a 


R 


0 


z 


/ 


0 


c 


z 


Z 


a- 


S 


} 


/ 


a 


Z 


z 


z 


i 


a 


T 


0 


/ • 


/ 


0 


z 


a 




/ 


U 


a 


/ 


z 


l 


/ 


0 


Z 




V 


z 


z 


0 


t 


0 


/ 


z 


o 


W 


z 


z 


l 


} 


z 


z 




/ 


o 


a 


z 


0 


z 


z 




Vr‘ 


o 



ERIC 



Do this after filling all the boxes* 



A+M 


a; 


Eng 


H 


G+S 


2-Q 


Lang_ 


H 


B+N 


zu 


Soc 


M 


H+T 


AT 


Math 


M 


C+0 




Bio 


L. 


I+U 


n 


Phy 


J± 


WE 


& 


Sec__ 


L 


J+V 


jjr_ 


Bus 


J± 


E+Q 


1! 


Home 


IA 


K+W_ 


a^r 


Shop 


M 


F+R 




Art 


IA_ 


L+X 


aa 


Mus 


H 



Directions: In the blank after the 

sum of two letters (such as A+M) , 
write the sun of the numbers written 
in those two lines at the leff D 
Write abbreviations of the fields 
with highest and lowest sums below: 

Highest i ll* *<? , 3 Mug . 

Lowes t * I Q 11 O , 12 

In the blank after the abbreviation 
of a field write L (low) , M (middle) , 
or H (high) depending on the number 
nearest your sum in the table below 
for BOYS or for GIRLS . 



BOYS 


L 


M 


H 


BOYS 


L 


M 


H 


Eng 


5 


14 


22 


Lang 


5 


15 


25 


Soc 


8 


17 


26 


Math 


7 


17 


27 


Bio 


9 


17 


26 


Phy 


11 


20 


29 


Sec 


9 


16 


23 


Bus 


10 


18 


26 


Home 


5 


13 


20 


Shop 


15 


23 


30 


Art 


7 


15 


23 


Mus 


5 


13 


22 


GIRLS 


L 


M 


H 


GIRLS 


L 


M 


H 


Eng 


11 


19 


27 


Lang 


11 


21 


30 


Soc 


8 


17 


26 


Math 


3 


13 


22 


Bio 


7 


16 


24 


Phy 


3 


12 


21 


Sec 


14 


22 


31 


Bus 


11 


19 


26 


Home 


19 


25 


31 


Shop 


3 


11 


19 


Art 


12 


20 


28 


Mus 


8 


17 


25 



If your siM is midway between two of 
these numbers, mark it M- or MK 



83 



- 107 - 

- 3 - 



To enable students to count these sums quickly and accurately in their heads, 
a "Scoring Aid 11 has been prepared and is reproduced below. It is probably the 
simplest scoring key ever devised for an instrument that yields twelve basic 
scores. The only specification it must meet is that it must be a third of a page — 
3 2/3 inches — from top to bottom. As the directions on the ''Scoring Aid" indicate, 
it is laid across the answer sheet with the top edge just below line A; then the 
bottom edge will lie just above line M„ The student counts the numbers he sees 
in these two lines — just above and below his "Scoring Aid" — -and writes the sum 
in the space at the right labeled A+M, This is easy to do since there are only 
16 numbers and each one is either 2* 1, or 0; hence the highest possible sum is 
32, and most sums are likely to be 20 or below. After recording the first sum, 
the student moves his "Scoring Aid" one line down and counts the sum of the 
numbers he has written in lines B and N. He keeps on doing this until he reaches 
the bottom of his answer sheet and has filled in all 12 sums called for at the 
top of the column at the right. 

He is next directed to write abbreviations of the fields in which he has 
the three highest and three lowest sums (raw scores). The abbreviations are 
printed just to the right of the spaces for recording these sums and are 
probably self-explanatory, except that Sec stands for Secretarial; Lang for 
Foreign Languages; Fhy for Physical Sciences; and Shop for the field called 
Industrial Arts in the standard form. As explained in the body of this report, 
the raw scores have some iimnediate and face-valid meaning, since they represent 
the number of times the student has said that iie likes (or dislikes) the activities 
representing each field. Note that "Tom Sample" has his three highest raw scores 
in Foreign Languages, Shop, and Music. 

Next, the student is directed to interpret each sum (raw score) by reference 
to the table for Boys or for Girls printed in the lower right-hand corner of the 
answer sheet- These are means and one standard deviation below and above for 
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all males and all females among the 30 pages of norms printed in this report 
for the standard form of this instrument. These are close enough to the low, 
middle, and high points given in any of the more specialized tables of norms to 
give an approximately correct notion at once of whether any given raw score is 
really high or low, or whether it is the normal, expected amount of interest 
expressed by the average boy or girl in grade 11* 

Take, for example, the first sum recorded by ’'Tom Sample”: a raw score 

of 21 in English. He glances at the table for Boys below and sees that this sum 
is closest to the High score for Boys, which is 22* He therefore marks this 
first sum H (for High). Note that English was not among his three highest raw 
scores, yet it was a high score for a boy; it would have been only a middle 
score for a girl. 

Then go on to the second sum recorded by "Tom Sample, a raw score of 21 
for Social Studies — exactly the same raw score as in English- — but this time it 
has to be marked M (middle) since it is closer to the middle score (17) for boys 
than to the high score (26). Although this student would probably feel that 
there was little to choose between these two fields — he liked one about as well 
as the other — his counselor may find it helpful to know that his English score 
was somewhat unusual for a hoy, while his Social Studies score was just a bit 
above average. Incidentally, if a sum is midway between two numbers given in 
the table, it is Marked M- or M4-. Since the dividing line is approximately 
half a standard deviation below and above the mean, in a large normal population 
about 30% of the sums will be marked L, 40% M, and 30% H* 

It may also be worthy of remark that, although his raw score in Shop was 
second highest for "Tom Sample," it was just a shade above average for a boy 
and hence is marked M, In the case of this student, it was known that his 
interest in Shop (do-it-yourself craft activities) was entirely a hobby interest, 
carried on in a home workshop, and was not reflected in his choices of electives 
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reflected in his program and his high interest in Music was expressed in his 
choice of school activities. The same sort of thing often happens with a high 
raw score in Home Economics for Is* That is normal and expected and often 
represents interest m activities carried on at home with no expectation of 
studying them in school. Thus the little table of norms for boys and for 
girls has a moderating influence on interpretations that might be drawn from 
the raw scores alone. It can bring to light scores that seem to be in the 
middle yet are unusually low or high for a boy or a girl; also apparently high 
or low scores that are really just average and have no particular significance 
for choice of studies or activities in school. 

Most 11 th grade classes that have thus far used this instrument are able 
to finish marking their responses in 25 or 30 minutes and then to score and 
interpret their responses with the fl Scoring Aid" in the remaining 10 or 15 minutes 
of a class period, A few classes that were unusually deliberate in marking their 
responses had to put off the scoring and interpretation until the first 15 minutes 
of class on the following day. It should be noted that students may also take 
this instrument as homework (since there is no point in faking responses) and then 
score and interpret their answer sheets the following day in class. The scoring 
and interpretation are better done in class, since the directions are a bit 
complicated, and the teacher usually has to explain them one part at a time. 

But the results are available Immediately without visible cost; in fact, the 
multilithed answer sheet costs much less than a machine- s cor able answer sheet, to 
say nothing of the cost of machine scoring. For further information on the 
self-scoring form of AIM, address the Office of Special Tests, ETS, Princeton, 

Halpern, G, Item arrangement and bias in an interest inventory. Educational 
and Psychological Measurement , 1968 , 28, No. 1111—1115. 
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Scoring Aid for ACADEMIC INTEREST tffiASURES (AIM), Self-Scoring Form, ETS 

Use this sheet to help you count the sum for each field on the answer sheet 
The first sum called for in the right-hand column is A+M, This means the sum 
of the nianbers you have written in lines A and M in the boxes at the left. Place 
the top edge of this sheet just below line A. The bottom edge will than lie just 

above line M, Add together (in your head) all the numbers you see just above the 

top edge and just below the bottom edge of this sheet. Write the sum (total) of 
these numbers in the blank after A+M, 

The next sum called for is B+N. Move this sheet down one line so that the top edge 
is just below line B, the bottom edge just above line N, Again, add together all 

the numbers you see just above the top edge and just below the bottom edge. Write 

this sian (total) in the blank after B+N. Keep on doing this, moving the sheet down 
one line at a time, .until you reach the bottom of the answer sheet. Write down all 
12 sums that are called for before you start to label them L, M, or H (low, middle, 
or high) by reference to the table for BOYS or for GIRLS, 
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